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We present a new global optimization algorithm in which the influence of the leaders 
in social groups is used as an inspiration for the evolutionary technique which is designed 
' into a group architecture. To demonstrate the efficiency of the method, a standard suite of 

' single and multi dimensional optimization functions along with the energies and the geometric 

' structures of Lennard- Jones clusters are given as well as the application of the algorithm on 

quantum circuit design problems. We show that as an improvement over previous methods, 
the algorithm scales as N"^'^ for the Lennard-Jones clusters of N-particles. In addition, an 
. , efficient circuit design is shown for two qubit Grover search algorithm which is a quantum 

, algorithm providing quadratic speedup over the classical counterpart. 

1. Introduction 

^ \ 

^ I Global optimization is one of the most important computational problems in sci- 

ence and engineering. Because of the complexity of optimization problems and the 



(N 



. high dimension of the search space, in most cases, using linear or deterministic 

CN \ methods to solve them may not be a feasible way pj. Wille and Vennik[2;] argued 

Tij- ■ that global optimization of a cluster of identical atoms interacting under two-body 

\ central forces, belong to the class of NP-hard problems. This means that as yet 

no polynomial time algorithm solving this problem is known. Recently, Adib 0] 
reexamined the computational complexity of the cluster optimization problem and 
suggest that the original NP level of complexity does not apply to pairwise po- 
^ ■ tentials of physical interest, such as those that depend on the geometric distance 

between the particles. A geometric analogue of the original problem is formulated 
and new subproblems that bear more direct consequences to the numerical study 
of cluster optimization where suggested. However, the intractability of this sub- 
problem remains unknown, suggests the need for good heuristics. 

Many optimization methods have been developed and then can be largely classi- 
fied into two groups, deterministic and stochastic. Deterministic methods include 
variations on Newton's method such as discrete Newton, quasi Newton and trun- 
cated Newton 0, tunneling method 0] and renormalization group methods 
Stochastic methods include, simulated annealirigB], quantum annealing^], J- 
wal king llQl, tabu search[lll|. genetic algorithms and basin-hoping approach 



o 



More recent work on probabilistic techniques have been proposed to solve 
these optimization problems by observing nature and modeling social behaviors 
and characteristics. Including genetic algorithms (GA), evolutionary algorithms 
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(EA) such as the particle swarm optimization algorithm (PSO) and the Pivot 
methods [l|,[ll-[23]. 



Implementation of many of these algorithms on complex problems requires ex- 
hausting computational time and a growing need for more computer resources de- 
pending upon: the dimension, the solution space and the type of the problem. The 
key to speed up the optimization process is reducing the number of computations 
in the algorithms while keeping the amount of iterations low and the success rate 
of the algorithms high. This paper introduces a new global optimization algorithm 
which reduces the optimization time, and is both simple and easy to implement. In 
the following sections, the inspiration and the implementation of the algorithm will 
be explained and test results will be given for some of the most famous optimiza- 
tion test problems; for the global optimization of the minimum energy structures of 
complex Lennard Jones clusters; and for the quantum circuit design of the Grover 
search algorithm. 



2. Inspirations and Related Works 

Leaders in social groups affect other members of their groups by influencing either 
the number of members or each member intensively [2l|]. Therefore, the effect of 
group leaders inclines the groups to have uniform behavior and characteristics 
similar to the leader. These new behaviors and characteristics may improve or 
worsen the quality of the members of a group. A leader represents the properties 
of its group. To become a leader for a group requires a person to have some better 
abilities than others in the group. 

Similar ideas to using leaders or/and grouping solution population have been 
the inspiration for optimization algorithms such as Cooperative Co-evolutionary 
Genetic Algorithms (CCGA), Cooperative Co-evolutionary Algorithms(CCEAs) 
22, [2^, and Parallel Evolutionary Algorithms(PEAs) p4 |. However, instead of 



trying to fully simulate the influence of leaders on their peers in social groups by 
constructing a population which includes small, interacting groups with their lead- 
ers, most of these and other similar algorithms have attempted the decomposition 
of big and complex problems into subcomponents or divide the whole population 
into multiple subpopulations with a parallel structure. In CCGAs, as described by 
Potter et al. [12], each species -which are evolved into subcomponents by using a 
standard genetic algorithm- represents a subcomponent of the potential solution, 
and each representative member of th e sp ecies is used to form the complete solu- 
tion of the optimization problem. In [25|], a general architecture for the evolving 
co-adapted subcomponents was presented in order to apply evolutionary algorithms 
to complex problems. Therefore, instead of GA, Particle Swarm Optimization Al- 
gorithm has been used for the subcomponents of Potter's CCGA structure by van 
den Bergh et al. [13]. Briefly, the general framework of cooperative coevolutionary 
algorithms has three main steps: problem decomposition, subcomponent optimiza- 
tion, and subcomponent adaptation [2^ ]. 

In PEAs the whole population forms in a distributed way and consists multiple 
subpopulation. Single-population master-slaves, multiple populations, fine-grained 
and hierarchical combinations are the main types of PEAs |27l |. The proposed 
algorithm in this paper differs from the PEAs in that all members of the population 
are interacting and there is a mutual effect between the members of the population 
in addition to leaders' effect on individuals in their groups. The sum of all these 
interactions forms the evolutionary technique. However, in PEAs, in most cases, 
the interaction between subpopulations is made with the migration of individuals 
and evolutionary techniques used for subpopulations can be independent from each 
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other. 



3. Group Leaders Optimization Algorithm 
3.1. General Idea 

Inspired by leaders in social groups and cooperative coevolutionary algorithms, we 
have designed a new global optimization algorithm in which there are separate 
groups and leaders for each group. Initially forming groups does not require mem- 
bers to have some similar characteristics. Instead, it is based on random selection. 
While CCGA and other similar algorithms decompose the solution space, and each 
group represents a solution for a part of the problem, in our algorithm each group 
tries to find a global solution by being under the influence of the group leaders 
which are the closest members of the groups to local or global minima. The leaders 
are those whose fitness values are the best in their groups, and a leader can lose its 
position after an iteration if another member in the same group becomes having a 
better fitness value. 

Since in social networks, leaders have effects on their peers, thusly the algorithm 
uses the some portion of leaders while generating new group members. Hence, a 
leader, (in most cases a local optimum) dominates all other solution candidates 
(group members) surrounding it, and the members of a group come closer and 
resemble their leader more in each iteration. By this way, the algorithm is able to 
search the solution space between a leader and its group members thoroughly, and 
so is able to search the area for a local or a global optimum (or an approximation 
of it) in a fast way. 

After a certain number of evolutions, it is obvious that the members may become 
too similar to their leaders. To maintain the diversity of the group, for each group, 
we transfer some variables from different groups by choosing them randomly. In 
addition to providing diversity, this one way crossover helps a group to jump out 
of local minima and search new solution spaces. 



3.2. Algorithm Steps 

In this section, algorithm steps are described with their reasons in sequence and 
are shown in Fig (1] and Figl2j 

Step 1 : Generate p number of population for each group randomly: 
The total population for each group is p, hence, the whole population is n * p 
where n is the number of groups. Creation of the groups and the members are 
totally random. 

Step 2: Calculate fitness values for all members in all groups: All so- 
lution candidates, group members, are evaluated in the optimization problem and 
their fitness values are assigned. 

Step 3: Determine the leaders for each group: Each group has one leader 
and the leaders are ones whose fitness values are the best within their respective 
groups. The algorithm steps 1-3 are shown in the Fig. 1. 

Step 4- Mutation and recombination: Create new member by using the old 
one, its group leader, and a random element. If the new member has better fitness 
value than old one, then replace the old one with the new one. Otherwise, keep the 
old member. For numerical problems, the expression simply reads; 



new = rl * old + r2 * leader + r3 * random. 



(1) 
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member-3 



member-p 



member-p 



member-p 



Figure 1. Steps 1-3 of the algorithm; groups consisting of p number of members are created, and their 
leaders are chosen based on the fitness values. 



In Eq.([T]), ri, r2, and are the rates determining the portions of old (current) 
member, leader, and random while generating the new population. Although in 
this paper, ri, r2, and will always sum to 1, it is not a requirement for the 
algorithm in general. For instance, let the current element be 0.9, the leader 1.8, 
and the generated random element 1.5, and suppose ri = 0.8, r2 = 0.19, and 
r3 = 0.01. In this case, the new element is equal to 1.077. Then fitness values 
of the old and the new element are checked. If fitness(1.077) is better than the 
fitness(0.9), then the old element is replaced by the new one. Pseudo-code for this 
step is as follows: 



for i = 1 to n do 
for j = 1 to p do 



newij = ri * memberij 



new 



+ r2 * Li + * random; 
better than fitness(memberij) 



then 



if fitness {new. 

membevi 
end if 
end for 
end for 

In the pseudo-code: n is the number of groups, p is the number of population in each 
group, ri,r2 and are the rates of old value of the members of groups, leaders, 
and the random part. The expression in the inner loop is the general formula of 
recombination and mutation for numerical optimization problems. 

Depending on the value of ri an element stays its original characteristics, and 
depending on the value of r2 it becomes more alike its leader during iterations. 
Thus, in some cases, choosing the right values for ri, r2 and may play an impor- 
tant role for the algorithm to get better results during the optimization. However, 
choosing these parameters by obeying the property, r3,r2 < 0.5 < ri allows one 
to have a thorough search of a solution space. Hence, this minimizes the effect of 
these parameters on the results. 

The main benefit of this evolution is that the algorithm becomes able to search 
the solution space surrounding the leaders (which are possibly local or global min- 
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S X S n, n is the number of group, 
1 ^ k< p, p is the number of 
population in each group, 
1 < pr s parameter, parameter is the 
ber of variables in each member 



member-2 



member-3 





member-p 



for i =l to redo 

["= rand om t {parame terl2 + \J[ 
for j = 1 to p do 

'"^random * n: 
■ random * p: 
pr = random * paramete;", 
newik = elementif;: 

if fitness(newif;) better than jitness{dmentik] then 

elementik = neufjjt; 
eiirl if 
end for 
piid for 



member-2 



member-3 



member-p 



Figure 2. Step 5 of the algorithm: one way crossover: prth variable of an element, member of the jth 
group, is replaced by prth variable of the fcth member of xth group. The same operation is repeated t times 
for each group (maximum -half of the number of variables plus one- times for each group). The arrow at 
the bottom of the figure shows the direction of transfer. 

ima). Therefore, this allows the population to converge upon global minima in a 
very fast way. The members of the groups are not subjected to a local minimiza- 
tion; however, an implementation of Lamarckian concepts of evolution for the local 
minimization [2^ gives a more stable and efficient algorithm. 

It is also important to note that Eq. ([1]) looks similar to the updating equation 
of PSO [17[. The difference is that a member is always at its best position and the 
best position of a member is not saved in a parameter as is done in PSO, hence 
there is no information about the member's(or the particle's) previous positions 
(values). 

Step 5: Parameter transfer from other groups (One way crossover): 

Choose random members starting from the first group, and then transfer some pa- 
rameters by choosing another random member from another group. If this transfer 
makes a member have a better fitness value, then change the member, otherwise 
keep the original form. This process is shown in Figl2]via pseudo code. This one- way 
crossover has similarities with the difference vector of Differential Evolution [29|]. 
The difference is that the transfer operation is between the members which are in 
different groups. In this step, it is important to determine correct transfer rate, 
otherwise all populations may quickly become similar. In our experiments, transfer 
operation rate was taken t times (t is a random number between 1 and half of the 
number of total parameters (variables) plus one (1 < i < Hp"''"™'^*'^'' _)_ 1)) for each 
group (not for each member). And each time, only one parameter is transferred. 

Step 6: Repeat step 3-step 5 number of given iteration times. 

Since each group looks for the solution in mostly different spaces, GLOA is able 
to search different solution spaces simultaneously. We did not put any constraint 
for groups to only search in subspaces, so a few groups may also search the same 
places. However, this does not make them redundant as they allow GLOA to find 
different local or global minima within the same subspace. Since each group has 
a leader and the leaders direct the other members of the group in order to search 
the area between the leader and the members of the group, it is able to search for 
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a good solution (around of the leader of the group). 

In addition to increasing the level of diversity of the groups, transferring some 
parameters (crossover) between groups allows the algorithm to direct the members 
of a group to search different spaces. Therefore, if a group has found some parame- 
ters correctly or very close to correct, then transferring parameters between groups 
allows other groups to get these parameters and find their solutions faster. Since it 
is transferred only parameters which make the member have better fitness value, 
the spreading of a member who has a bad fitness value is avoided. In terms of op- 
timization problems requiring highly diverse populations, choosing to do crossover 
and mutation-recombination steps without comparing fitness values may be wise 
and may improve the effectiveness of the algorithm. 



4. Optimization Results 

The parameters for the algorithm have effects on the quality of results. As it is 
stated in the previous section, choosing r3,r2 less than and ri greater than 0.5 
makes the algorithm more stable and minimizes the effects of these parameters. 
The number of groups and the population of the groups should be chosen to be large 
enough depending on the complexity of the problem. Therefore, while generating 
new elements, the rate of crossover between groups and the portions of elements, 
leaders, and random elements should be carefully adjusted for the type and the 
complexity of the optimization problem. For instance, if one takes crossover rate 
or the portion of the leaders too high in relation to the chosen group and popula- 
tion number, this may cause the whole population to become uniform very quickly. 
Hence, the algorithm may get stuck in a local solution, and not search the whole 
solution space. The algorithm was tested on different type of optimization prob- 
lems, one dimensional and multi dimensional optimization test functions, and it 
was also used to find the minimum energy structures of Lennard Jones Clusters. 

4.1. Test Functions 

While testing optimization algorithms on numerical problems, search domain and 
the number of iteration have crucial effects on the performance of the algorithms. 
In terms of the implementation, the number of groups and the population were 
taken the same for all numerical problems where the number of groups is 10, and 
the population number in each group is 25. Keeping the number of leaders the same 
for all numerical test functions which have different numbers of local minima shows 
the capability of the algorithm to escape from local minima is not highly related 
to the number of leaders. While results are shown in terms of function value and 
the number of iteration in graphs for single dimensional test problems, for multi 
dimensional problems, they are presented in terms of the number of dimension (up 
to 1000) and the minimum function value in each dimension. 

4.I.I. Single Dimensional Test Problems 

For the single dimensional test functions, the parameters of the algorithm are 
shown in Table-ID In this table, = 0, that means that there is no randomness 
while generating new populations. We observed from our optimization that this 
makes GLOA converge to a global minima faster for single dimensional test prob- 
lems. 

Also, as shown in FiglSl after the algorithm has gotten stuck in a local minima for 
some number of iterations where the minimum function values are not changing. 
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Table 1. Parameters used for single dimensional test functions 



Parameters 


Values 


number of groups 


10 


number of population in each group 


25 


ri(the portion of element) 


0.8 


r2(the portion of leader) 


0.2 


r3(the portion of random) 


0.0 



it is still able to find the global minima at the end. That exemplifies the ability of 
the algorithm to jump out of the local minima and search for the global minima. 

The first test function used in the optimization is the Beale Function (30l | shown in 
Eq.Q. The global minimum for this function is located at f{x) = 0, where xi = 3 
X2 = 0.5. The search domain was taken to be [-100,100], —100 < (xi,X2) < 100. 
Fig 3(a) shows the test result for the Beale Function. 



fBeale{xi,X2) = [1.5 - Xi(l - X2)]' + [2.25 - Xi(l - x^)]" + [2.625 - Xi(l - xl)f 



(2) 



Secondly, the Easom Function [3 1[| which is shown in Eq.Q and has a global 
minimum located at /(x) = —1, where xi = vr X2 = vr. The search domain for this 
function was taken as [-100,100], —100 < (xi,X2) < 100, in the implementation, 
and the result is presented in Fig 3(b)[ 



fEasom{xi,X2) = -COs{xi)cOs{x2)exp (-(xi - Trf - (x2 - Vt)^) . (3) 



Another single dimensional test function is Goldstein-Price's Function [31l ]. 
Eq.@. The global minimum for this function is at /(x) = 3 where xi = X2 = —1. 
The search domain used for this problem is [-100,100] —100 < (xi,X2) < 100, and 



the result is shown in 3(c) 



/gp(2;i, X2) = [1 + (Xi +X2 + 1)^(19 - 14X1 + 13x? - 14X2 + 6X1X2 + 3x^]* 

(4) 

[30 + (2x1 - 3x2)^(18 - 32x1 + Uxj + 48x2 - 36xiX2 + 27x^]. 



Shubert's Function|31[] is the last single dimensional test function used in the 
experiments. This function, Eq.([5|), has a global minima at /(x) = —186.7309 for 
the search domain [-10,10], —10 < (xi,X2) < 10. Fig |3(d)| shows the result for this 
function. 



fshubert{xi,X2) = icos[{i + l)xi + i] j . |^^[zcos(z + l)x2 + i] j ■ (5) 

4- 1-2. Multi-Dimensional Test Functions 

Five multi dimensional test functions were used as test cases. Each of these 
functions has different properties. The number of groups and populations are taken 
to be the same as in single dimensional functions (number of groups is 10 and 
number of populations in each group is 25). The other algorithm parameters and 
the number of iterations for these functions are given in Table-EJ The number of 
iterations separately given for each function in the table were taken to be the same 
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Easom Funclion 




(a) Bcale Function 



(b) Easom Function 



Goldenslein-Price Funclioi 




Shubert Function 




(c) Goldenstoin-Price's Function 



(d) Shubert Function 



Figure 3. Results For Single Dimensional Optimization Test Functions: x-axis represents the number of 
iterations and y-axis is the function value which is the result of the best member in the population. a)The 
Result for Beale Function b)The Result for Easom Function c)The Result for Goldein-Price's Function 
d)The Result for Shubert Function 



at all dimensions. The algorithm was implemented upon each multi dimensional 
test function at sample dimensions, up to 1000. Therefore, for these optimizations, 
comparisons of running time of GLOA with the number of dimensions are shown 
in terms of seconds in Fig 5(f) (Times in Fig |5(f)| were taken from Matlab which 
was running on a laptop computer with 1.83GHz Intel Core Duo CPU.). 
Multi-dimensional test functions that were used in test cases are as follows: 



Rosenbrock's Banana Function ]2n. \3(a-\32I: 



n-l 



fn{x) = Y,[100{Xi - X,+if + {Xi - 1)2]. 



i=l 



(6) 



The function value at fn{x) = is minimum for x = (1, 1). The optimization 



results of the algorithm for this function is shown in Fig 5(a) in which it is seen 
that the function values even at 1000 dimensions are always less than 1. That 
means the error(e) is also less than 1, e < 1, for all dimensions. Since all multi 
dimensional functions were tested for up to 1000 dimensions; for the following 
functions we will only give the function descriptions and the error terms. 
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Tabic 2. Parameters used for multi dimensional test functions 



Test Function 


ri 


r2 




domain 


number of iteration 


Griewank 


0.8 


0.19 


0.01 




-600,600] 


1000 


Ackley 


0.8 


0.19 


0.01 


[-32.768,32.768] 


1000 


Rosenbrock 


0.8 


0.1 


0.1 




-100,100] 


2000 


Sphere 


0.6 


0.2 


0.2 


[-100,100] 


1000 


Rastrigin 


0.6 


0.2 


0.2 




-10,10] 


1500 



Griewank 's Function f22 . \32J : 



n 9 



i=l 



4000 



r[cos(^). 

r=i 



This function is minimum at fn{x) = 0, where x = (0,0, 
shown in Fig |5(b)| and e < 0.1 for ah dimensions. 

Ackley 's Function [2^]: 



(7) 



The results are 



fnix) = 20 + e- 20exp -0.2, 



1 " 

- V 



exp 



cos {2 



TTXi 



(8) 



vi=l 



At fri{x) = 0, where x = (0,0,..), the function value is minimum. The results 



are shown in Fig 5(c) and e < 0.05 for all dimensions. 



Sphere Function [32 1: 



Ux) = 



(9) 



1=1 



The minimum of the function is located at fnix) = 0, where x = (0,0, ..). The 



results are shown in Fig, 5(d) , and e < 0.1 for all dimensions. 



Rastrigin Function \2n . \23i] : 

n 

fn{x) = 10n + Y i^'i - (2vrxi)) . 



(10) 



1=1 



At fn{x) = 0, where x = (0,0,..), the function value is minimum. The results 
are shown in Fig 5(e) and e < 0.05 for all dimensions. 



4.2. Lennard-Jones Clusters 



The Lennard-Jones(LJ) potential describes the interaction of a pair of neutral par- 
ticles. The total potential of interactions between N-particles is defined in Eq. (jlip . 



and the pair potential is shown in Fig 6(a) Finding the minimum energy struc 



ture of interaction between pairs can be described as an optimization problem. 
The problem is to place the particles in 3-D space such that their total interaction 
energy is at minimum. 

Global optimization of L J clusters is one of the most intensely studied molecular 
conformation problems since it is simple and accurate enough to describe real 
physical interacting systems. Moreover, the simulation results of LJ clusters can 
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Table 3. Parameters of the Algorithm for the global optimization of LJ clusters 



Parameters 


Values 


number of group 


15 


number of population in each group 


30 


the domain of ri 


[0.85,0.95] 


the domain of r2 


[0.15,0.05] 


the domain of 


[0.001,0.0001] 


initial generated population domain 


[-2,2] 


maximum number of iteration 


3000 



be directly compared with the laboratory results [11]. Because the number of local 



3|], the 



minima in the surface of an LJ cluster grows exponentially with N [35 
solution of the problem is very complex and difficult [3].j_For instance, for the 
cluster of 13 particles, there are about 1500 local minima [35]. Thus, finding the 
minimum energy structure of LJ clusters is still an open and attractive research 
area and a good benchmark problem for the optimization algorithms ^3^. 
The interaction potential is given by: 



N 



E 



Kj 



/ \12 













where rtj is the distance between two particles. For simplicity we will take e = 1 
and o- = 1 [li]. 

In the implementation, the solution of one cluster was used as initial guess for a 
larger cluster, this significantly shortened the optimization time (refer to Fig ]6(b)l ). 
Here, the sum of algorithm parameters ri and r2 is taken to be 1, while is set 
sufficiently small to locate the values of particles with high precision. Table [3] gives 
the values of the parameters used in the optimization. In addition, as the crossover 
between groups is done, the transferred elements are mutated. This mutation rate is 
determined also by the parameter r^. This mutation does not change the transferred 
value dramatically; however, it helps the algorithm to decrease number of iteration 
needed for small mutations. 

The algorithm was run to locate the minimum energy structure for the clusters 
of 5-42, 38, 55, 65, and 75 particles. This running choice helped us to observe the 
growth of the computation time with respect to the number of particles. The opti- 
mization process was terminated if either the absolute error which was defined as 
the absolute difference between the known lowest (reported in [s^) and the found 
energy level was less than 0.001 or the maximum number of iterations (3000) was 
reached. The algorithm has been able to find the lowest known energy structure 
with the absolute errors all of which are less than 0.1. The clusters of 38 and 75 
particles are known to be difficult cases for optimization algorithms. For these cases 
the first encounter times of the algorithm from 100 random starting points (the pre- 
vious structure is not used as an starting point) are shown in Fig 6(c) and Fig 6(d)| 
respective to 38 and 75 particles. The computational time of the algorithm with 
respect to the cluster size is given in Fig 6(b) Thus, the scaling of the algorithm 
with respect to the number of particles is iV^^^, which is an improvement over the 
previous reported scalings: N^''^ for the genetic algorithm and A^^'^ for the pivot 
methods la, 37]. However, in terms of first encounter time, we see that GLOA in 
this present format is not as successful as the global optimization by basin-hoping 



for LJ clusters [14]. 
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4.3. Quantum Circuit Design 

In the field of quantum computation, finding quantum circuit designs by decom- 
posing a given unitary matrix into a proper-minimum cost quantum gate sequence 
for tlie implementation of quantum algorithms and the simulation of molecular 
systems are of fundamental importance. Evolution of quantum circuits faces two 
major challenges: complex and huge search space and the high costs of simulat- 
ing quantum circuits on classical computers. The optimization task involves not 
only finding the right sequence of gates, but the minimization of the cost of the 
sequence as well. In the circuit model of quantum computing, each computation 
or algorithm can be defined as a unitary matrix. Thus, the problem becomes the 
decomposition of a given unitary matrices into a sequence of unitary operators 
which are describing the defined quantum gates. For this optimization problem, 
the objective function to be minimized is defined as follows: 



l-{aC+ ^ 



Cost' 



(12) 



where C is a value to determine the correctness of the circuit; Cost is the imple- 
mentation cost of the found circuit design; and a and /3 are weights to adjust the 
importance of the correctness and the cost of the circuit in the objective function. 



The correctness (C) is defined as 



N 



where Ug and Uf are the given and 



the found unitary matrices of order N, relatively; Tr(...) is the trace of a matrix; 
and N is the 2" (n number of the qubits). When Ug = Uf, because all the diago- 
nal elements of the product of Ug and Uf becomes ones, the correctness value is 
one (C is always in the range of one and zero). The cost of a circuit is defined as 
arbitrarily by considering the common implementation costs of quantum gates in 
different quantum computer models: the number of control qubits and the distance 
between the target and the control qubits of a gate in the circuits which involve 
many qubits. Hence, the cost of a control gate are determined by multiplying the 
distance (number of qubits) between the target and the control qubits of the gate 
by two, and the cost of a single gate is taken one. The cost of a circuit is found by 
summing up the cost value of each quantum gate in the circuit. 

In the optimization, a and (3 are considered as 0.9 and 0.1 which are the best 
choice among different alternatives to reduce the number of iterations and increase 
the correctness. The members in the population of the group structured algorithm 
are taken as genomes which represent a circuit as a numeric string describing gates 
and their target-control qubits and angles. The order of the gates in a genome 
represents their order in the circuit with respect to the string: The string, 2 3 2 
0.3 3 2 1 0.5, represents two quantum gates with related to the integers 2 and 3 
with their target and control qubits and their angle values: 3 2 0.3 and 2 1 0.5, 
respectively. 

As a test case, we use the Grover search algorithm [s^ which is one of the 
advances quantum computing has brought on classical computing. It reduces the 
computational time of a brute force search from 0{N) to 0{^/N). The algorithm 



can be described in four steps [39|, l40l ]: 



(1) Start with an n-qubit initial state |000..0). 

(2) Put this initial state into the superposition by applying Hadamard (H) 
gates to the each qubit. 

(3) IIVN\ times: 
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Table ■ 



Parameters of the Algorithm for Finding Quantum Circuits 



Parameters 


Values 


number of group 


15 


population in each group 


25 


ri 


0.8 


r2 


0.1 




0.1 


number of iteration 


1000 



X 



R,.f4,712) 




X 






/?,.(1.5705) 







Figure 4. Quantum circuit design for the inversion about the average part of the Grover search algorithm. 



Apply the first operator Uf which is defined as: 

U f = I — \a) {a\, 



(13) 



where a is the element that is being searched, and / is the identity. The 
act of Uf is to mark the element x if and only if a; = a; the function, 
/(x), is equal to 1 for x = a. 

Apply the second operator (the inversion about the average operator 
or diffusion operator) U^i- which is defined as: 



C/^. =2|V)(V| 



(14) 



U^i- amplifies the amplitude of the state marked by the first operator and 
reduces the amplitudes of the rest. Thus, the probability of seeing the 
marked element at the end of measurement gets higher. The matrix D 
representing this operator is found as follows: 



f, ifi^j 



(15) 



(4) Measure the result. 



The exact circuit design in FigHlfor the second part (inversion about the average) 
of the Grover search algorithm (matrix elements of which are -0.5 in diagonal and 
0.5 in the rest) is found with the objective function value 0.08 by applying the 
algorithm with the parameters given in Table HI 



5. Conclusions 



In this paper we have presented the Group Leaders Optimization Algorithm 
(GLOA). The algorithm is quite efficient, very flexible, rarely gets trapped in local 
minima, does not require computationally expensive derivatives, and is quite easy 
to implement. Flexibility is further enhanced by the ability to incorporate any pre- 
vious knowledge of the potential under investigation into the optimization. As a 
specific example, we used smaller Lennard-Jones clusters as the starting point for 
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the larger ones. Reducing the computational cost to scale approximately as N'^'^ 
is very promising to treat larger complex systems. 

Recently, in a promising new direction, we demonstrate that a modified Grovers 
quantum algorithm can be applied to real problems of finding a global minimum 
using modest numbers of quantum bits[4Q]. Calculations of the global minimum 
of simple test functions and Lennard-Jones clusters have been carried out on a 
quantum computer simulator using a modified Grovers algorithm. The number of 
function evaluations N reduced from 0(N) in classical simulation to 0(N^/^) in 
quantum simulation. We also show how the Grovers quantum algorithm can be 
combined with the classical Pivot method for global optimization to treat larger 
systems. We currently investigating combining this new algorithm, the Group Lead- 
ers Optimization Algorithm, with the Grover's quantum algorithm for global opti- 
mization of complex systems. The algorithm defined here also allows us to design 
quantum circuits for further quantum algorithms and the simulations of molecular 
Hamiltonians such as the Hamiltonians of H2O and H2- 

Therefore, because of the parallel group structure of the algorithm, it can be 
easily adapted to a parallel processing environment to improve the efficiency of 
the algorithm for hard problems. In that case, each of the groups can be run on a 
different machine and the parameter transfer between groups can be done through 
either a shared memory or a message-passing interface. 
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Figure 5. Results For Multi Dimensional Optimization Test Functions: for (a)-(e), the x-axis is the number 
of dimension, and the y-axis is the function value which is the result of the best member in the population. 
For (f), the x-axis is the number of dimension, and the y-axis is the running time of the algorithm, (a) 
shows the result for Rosenbrock Function; (b) is the result for Griewank Function; (c) is the result for 
Ackley Function; (d) is the result for Sphere Function; (e) is the result for Rastrigin Function; and (f) 
shows the CPU running time of the algorithm with respect to the dimension of the problems. 
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Figure 6. In (a), Lennard- Jones pair potential are shown for two particles which is the minimum at atomic 
distance 1. In (b), the dots are the measured CPU time for the cluster of different number of particles; the 
solid line which grows with the order of 0(n^'^) is the fitted curve for the measured data (n is the number 
of particles), (c) and (d) show the first encounter time of the algorithm for 100 random starting points for 
the clusters of 38 and 75 particles. 
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